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An  optical  image  segmentor  using  neural  based  wavelet  filtering  techniques 
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ABSTRACT 


This  paper  presents  a  neural  based  optical  image  segmentation  scheme  for  locating  potential  targets  in 
cluttered  FLIR  images.  Tlie  advantage  of  such  a  scheme  is  speed,  i.  e.,  the  speed  of  light.  Such  a  design  is 
critical  to  achieve  real-time  segmentation  and  classification  for  machine  vision  applications.  The  segmentation 
scheme  used  was  based  on  texture  discrimination  and  employed  biologically  based  orientation  specific  filters 
(wavelet  filters)  as  its  main  component.  These  niters  are  the  well  understood  impulse  response  functions  of 
mammalian  vision  systems  from  input  to  striate  cortex.  By  using  the  proper  choice  of  aperture  pair  separation, 
dilation,  and  orientation,  targets  in  FLIR  imagery  were  optically  segmented.  Wavelet  filtering  is  illustrated  for 
glass  template  slides,  as  well  as  segmentation  for  static  and  real-time  FLIR  imagery  displayed  on  a  liquid  crystal 
television. 
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Subject  Terms:  Gabor  Transforms,  Segmentation,  Optical  Neural  Networks,  Texture  Discrimination,  Image 


Processing,  FLIR  Images,  Optical  Pattern  Recognition. 


1.  INTRODUCTION 


Segmentation  of  potential  targets  from  c'mttered  images  is  a  •■ritical  step  before  classification  of  the  target  can 

begin.  Over  the  past  25  years,  several  segnientatioii  algorithms  have  been  developed  at  the  Air  Force  Institute 

1234567 

of  Technology  (AFTT)  . ,  however,  they  are  heuristic  in  nature  and  use  non-linear  mathematical 

manipulation  of  data — algorithms  not  readily  implemented  optically  and  computationally  intense  for  real-time 

use.  In  a  recent  research  effort  at  AFTT,  Gabor  filtering  techniques  were  applied  in  a  digital  algorithm  that 

successfully  segmented  Forwarded-Looking  Infra  Red  (FLIR)  imageiy  and  provided  a  linear  algorit/'.m  that  could 

be  applied  optically  .  Gabor  functions  have  been  shown  to  be  a  good  model  foi  the  impulse  response  function 

9  10 

of  mammalian  visual  systems  .  The  optical  image  segmentor  presented  m  tliis  paper  adopted  a  similar 
linear  algorithm  as  in  the  digital  approach,  but  also  tested  a  different  type  of  wavelet  filter  other  than  the  Gabor. 
The  optical  implementation  allows  for  instantaneous  and  automatic  segmmatution  of  real-time  FLIR  imagery  for 
machine  vision  processing. 

Neurol  network  classification  schemes  at  AFIT  have  incorporated  the  optical  segmentor  as  a  front  end  p;o- 
cessor  Such  a  scheme  is  shown  in  Figure  1.  Essentially,  the  optical  segmentor  limits  the  field-of-view 
of  the  classification  neural  network  to  potential  targets  in  the  scene  and  feeds  the  classification  neural  network 
the  wavelet  conelation  values  as  discriminant  features  to  process.  The  neural  network  shown  is  a  collection  of 
specific  neural  networks  each  trained  to  recognize  only  one  class  of  objects  based  on  an  optimized  set  of  wavelet 
correlation  values.  The  output  of  the  neural  network  is  then  used  as  feedback  to  the  optical  segmentor  to  generate  a 
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customized  wavelet  filter  based  on  the  network’s  determination  of  the  most  probable  class  of  tlie  segmented  object. 
The  loop  is  iteratively  processed  until  a  desired  threshold  is  reached  or  the  classification  network  is  no  longer  able 
to  improve  classification  capability.  Once  the  classification  has  been  made,  the  prccess  can  be  repeated  for  other 
items  of  interest  in  the  correlation  plane. 


The  optical  architecture  presented  uses  a  liquid  crystal  television  (LCTV)  spatial  light  modulator  (SLM)  as  a 
grey-scale  amplitude  modulator  for  displaying  static  and  real-time  FLIR  imagery'  as  inputs  into  the  optical  setup. 
Over  the  past  five  years,  LCTVs  have  been  demonstrated  as  capable  amplitude  and  phase  SLMs  in  optical  image 
processing  setups  in  vanous  research  projects  .  The  mam  advantage  or  LCTVs  is 

low  cost  (approximately  $1(X)  to  $12(X)),  and  their  main  disadvantage,  is  low  resolution  (pixel  sizes  or.  the  order 
of  370  /rm).  The  low  resolution  of  the  LCTV  posed  some  optimization  problems  in  this  research  effort,  but  the 
requirement  for  grey-scale  capability  made  the  LCTV  the  most  suitable  choice  over  other  SLMs.  The  limitations 
of  using  an  LCTV  for  this  application  are  discussed.  Also  note  that  many  of  the  digitized  camera  images  presented 
were  reversed  imaged,  i.e.,  light  areas  are  presented  dark  and  dark  areas  are  presented  light.  This  was  done  to 
highlight  the  areas  of  intern  better. 


The  design  of  the  segmentation  filters  used  is  based  on  2-dimensional  Gabor  wavelet  filtering  techniques 

22  23  9  24 

employed  as  a  digital  image  processing  tool  for  texture  segmentation  ’  ’  ’  .  The  2-D  Gabor  wavelet  can  be 

described  as  a  modulated  Gaussian  “window”  whicli  possesses  the  distinct  property  of  maintaining  the  theoretical 

9 

lower  bound  of  joint  uncertainty  in  the  space/frequcncy  domain  .  Joint  uncertainty  refers  to  the  space  and 
frequency  resolution  of  the  function.  An  example  of  a  2-D  cosine  Gabor  function  (space  donia!'')  and  its  2-D 
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Fourier  transfomi  (frequency  domain)  is  given  in  Figure  2.  In  addition,  Gabor  wavelets  have  been  proposed  as 
good  models  for  the  2-D  receptive  fields  of  mammalian  visual  cortex  simple  cells  (neurons)  .  In  this  sense,  the 
optical  segmentor  presented  in  this  article  can  truly  be  called  an  optical  neurocomputcr. 

One  way  to  understand  the  segmentation  process  employed  is  to  think  of  the  filters  as  “orientation  spccilic, 

bandpass  spatial  filters”.  Orientation  specific,  bandpass  spatial  filtering  implies  frequency  discrimination  or 

“textural”  discrimination  at  a  specific  orientation  of  the  texture.  Similar  biological  processing  has  been  known  to 
25 

exist  since  1962  “■  .  Optically  segmenting  distinct  textures  requires  passing  their  dominant  spatial  frequencies 

through  symmetric  apertures  at  appropriate  separations  and  orientations  and  blocking  out  the  rest  of  the  spectrum. 

Thus,  orientation  specific,  bandpass  spatial  filters  are  nothing  more  than  symmetrically  located  apertures.  The 
apertures  of  choice  would  be  symmetrical  gaussians,  as  shown  in  Figure  2b,  in  order  to  take  advantage  of  the  lower 
bound  of  die  joint  uncertainty  relationship.  To  this  end,  gaussian  apertures  were  fabricated  during  the  course  of 
this  research  using  detour-phase  computer  generated  holography  (CGH),  an  example  of  which  is  shown  in  Figure  3 
along  with  its  3-D  transmission  profile.  However,  these  filters  were  not  easy  to  fabricate  and  transmitted  too  much 
undesired  image  spectrum. 

A  much  simpler  solution  to  employing  wavelet  filtering  was  to  use  circular  apertures  instead  of  gaussian 
apertures.  In  the  space  domain,  one  could  think  of  them  as  Airy  disc  wavelets.  In  other  words,  if  we  model  the 
circular  apertures  as  having  constant  intensity  across  them,  then  the  transmiitance  function  of  a  symmetric  aperture 
pair  can  be  expressed  mathematically  in  the  frequency  domain  as; 

T(^,  7?)  =  *  [<5(^  -  so.  V  -  %)  +  +  ^0.  V  ri-  %)]  ( i ) 
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Figure  1:  Neural  Network  Based  Automatic  Tai^er,  Recognizer 


Figure  2:  (a)  Example  of  a  2-D  cosine  Gabor  function  (b)  2-D  Fourier  transform  of  (a) 
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Figure  4;  Digital  representation  of  the  transmission  function  of  symmetric  circular  apertures 
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where: 


p<ll2 

otherwise 


(2) 


represents  a  convolution,  6  represents  a  delta  function,  p  =  represents  a  distance  along  the  ^ 

direction,  t/q  represents  a  distance  along  the  r;  direction,  and  I  represents  the  circular  dilation  (diameter).  A  2-D 
digital  representation  of  the  transmission  function  of  symmetric  circular  apertures  is  shown  in  Figure  4. 


The  “inverse”  Fourier  transform  of  the  symmetric  circular  aperture  pair  can  be  expressed  mathematically  in 
the  space  domain  as  an  Airy  disc  wavelet; 

t(a:,  y)  =  +  VoV))  (3) 

where,  r  —  +  y-  and  J i  tepicseiils  a  fust-order  Bessel  function. 
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Furthermore,  Goodman  derived  the  intensity  of  an  Airy  disc  which,  combined  with  the  square  of  the 
sinusoid,  gives  the  intensity  function  of  the  Airy  disc  wavelet: 

I(x,y)  =  |t(x,y)|^  = 

A  2-D  digital  representation  of  the  intensity  function  of  an  Aiiy  disc  wavelet  is  shown  in  Figure  5.  The  figure 
shows  both  a  side  view  and  a  view  looking  straight  down.  The  middle  lobe  was  clipped  at  the  top  in  order  to 
emphasize  the  side  lobe  oscillations  more,  however,  at  full  scale  the  first  side  lobe  of  an  Airy  disc  function  is  less 
than  2%  of  the  amplitude  of  the  middle  lobe. 


Jl  (rr/r/A/) 


(TTIT/AJ) 


[cos  (27r(^o2:  +  wj))l‘ 


(4) 


Using  Equation  4,  the  number  of  cycles  in  the  middle  lobe  of  the  Airy  disc  can  be  predicted.  If  ry  is  the 
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distance  from  the  origin  to  the  first  zero  crossing  of  the  Airy  disc,  then 


1.22A/ 


Additionally,  the  spatial  frequency  of  the  wavelet  can  be  given  in  terms  of 


2/9 


Thus,  the  number  of  cycles  over  the  total  lobe  can  be  calculated  from  Equations  5  and  6  as: 


#cycles  ^  4.r8p 

- -  -  =  2ro2^o  =  — i — 

centerlobe  I 


For  exauiple,  if  ilic  aperture  separation  is  2  liim  (p  =  1  nun)  and  tire  aperture  dilation,  1,  is  I  rniu,  ilieii  .lie  auruber  of 
cycles  per  middle  Airy  disc  lobe  should  be  4.88  cycles/lobe.  Note  that  this  result  is  independent  of  the  wavelength 
of  the  laser  or  the  focal  length  of  the  lens. 


Recall  that  the  Gabor  wavelet  (modulated  gaussian)  was  the  best  choice  of  filter  for  mathematical  reasons, 

nc  n  if  nmc'  <*001  r  f/~»  imnlonr»4»r»f  nrxfir»ollir  ifc  oonfrol  1 

Aiv/  TT  r  kiAW  a  a 4ft ^  tv  u  r  wms/t.  vt  uo  v/ftftv/tJVftft  cftvi  u  ftftft4.W4  w^^uiftO^  *!•  ft-v'  kftV'ftAXA^  j  UAft\.4  ftbo  v^v^ftftkft ftAi.  iv./L/w 

approximated  a  Gabor  wavelet  well.  The  central  lobe  of  a  gaussian  function  and  an  Airy  pattern  (the  envelopes  of 

the  wavelets  in  tlic  space  domain)  have  similar  shapes,  and  although  the  Airy  pattern  possesses  sidelobes  which 
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comprise  about  16%  of  its  intensity  ,  the  intensity  is  well  distributed  between  them  resulting  in  their  having 
little  or  no  effect  in  the  correlation  output. 


The  implementation  of  the  symmetric  circular  aperture  filters  was  trivial  and  only  required  that  some  medium 


be  placed  in  the  filter  plane  that  could  be  impressed  with  small  circular  apertures  (pinholes)  to  pass  the  desired 


spectral  coefficients  and  block  the  rest  of  the  image  spectrum.  The  medium  of  choice  was  heavy,  black  aluminum 
foil,  since  it  was  readily  available,  required  no  special  tools  or  software  to  manipulate  (i.e.,  drill  press  or  computer), 
and  retained  its  shape  fairly  well  (some  slight  microscopic  tearing  was  unavoidable).  The  filters  were  made  by 
cutting  and  smoothing  5  cm  x  5  cm  pieces  of  foil,  then  impressing  circular  aperture  pairs  into  them  using  a  pin. 
The  apertures  were  placed  along  a  commoii  axic  symmetrical  to  an  origin  (middle  of  the  foil).  Separations  of 
apertures  varied  from  2  mm  to  12  mm.  Diameters  of  apertures  varied  from  about  0.5  mm  to  3  mm.  Orientations 
were  not  limited  since  the  filters  were  placed  in  a  rotating  mount  witli  a  360°  range.  Figure  6  shows  four  different 
wavelet  spectral  images  recorded  from  an  optical  bench  from  four  different  pinhole  pair  filters  and  demonstrates 
the  effect  of  changing  aperture  separation,  dilation,  and  orientation.  An  alternative  to  a  fixed  filter  approach  is 
to  use  an  electronically  addressed  binary  magneto-optic  SLM  which  would  allow  for  real-time  filter  selection,  as 
implied  by  Figure  1. 


3.  SETUP  FOR  OPTICAL  SEGMENTATION 


The  basic  setup  used  to  perform  optical  segmentation  is  given  in  Figure  7.  Input  images  were  placed  at  Pq,  and 
spatial  filters  were  placed  at  Ft .  The  only  difference  between  this  setup  and  a  general  spatial  filtering  4- /  setup 
is  two  extra  lenses  which  increase  the  size  of  the  input  image  spectrum  incident  on  the  spatial  filter  at  Pi.  Hence, 
this  setup  could  be  called  an  8  •/  setup.  An  increase  m  the  spectrum  size  allows  the  individual  spatial  frequencies 
(diffraction  orders)  to  be  identified  and  segmented  more  easily.  For  example,  the  relationship  between  input  image 
spatial  frequency  and  spectrum  location  is 

(8) 

where  fx  is  the  i-coniponent  of  the  spatial  frequency,  ly  is  the  a; -component  of  tlie  spectrum  location,  A  is  the 
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a. 


b. 


Figure  5;  Digital  reptesentation  the  intensity  function  cf  an  Airy  disc  wavelet  at  given  at  two  viewpoints:  (a) 
sideview;  (b)  topview 


Figure  6:  Wavelet  spectral  images  of  pinhole  filters:  (a)  separatioii=2  mm  dilation=.5  mm,  oiientation=0° ;  (b) 
2,.5,90°;(c)  2,1,0'^' ;(d)  4, .5,0° 
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wavelength  of  the  source,  and  /  is  the  focal  length  of  the  lens.  Thus,  if  /*  =  10  cycles/cm,  A  =  488.0  nm,  and 
/  =  300  mm,  tlien  Xf  =  0.146  mm,  which  is  physically  too  small  to  segment  easily.  However,  if  we  magnify  x j, 
say  1.5x,  it  has  a  dimension  of  1.01  mm,  which  is  more  easily  segmented. 


An  argon-ion  laser  (A  =  488.0  nm)  was  used  for  the  coherent  light  source..  The  beam  was  collimated  to  a  3  1/2 
inch  diameter  with  a  lOx  microscope  objective,  a  15  /rm  pinhole,  and  a  150  mm  focal  length,  5  1/2  inch  diameler 
lens  in  order  to  use  as  much  of  the  LCTV  screen  as  possible  (the  LCTV  was  a  modified  Sony  Video  Walkman  and 
had  a  4  inch  diagonal  screen).  The  final  setup  configuration  had  300  mm  compound  lenses  for  ii,  ^3,  and  L4,  and 
a  simple  40  mm  convex  lens  for  Thus,  the  magnification  of  the  spectrum  was  7.5x.  An  ins  placed  in  front  of 
Li  served  as  an  aperture  stop  and  cut  down  on  the  high  frequency  interference  between  pixels  when  the  LCTV 
was  used  as  an  input  device.  A  Sony  CCD  camera  was  placed  at  P,  to  record  the  output  images.  The  camera  was 
connected  to  an  AT&T  TARGA  framegrabber  in  a  Zenith  286  computer. 


4.  SEGMENTATION  RESULTS 


Wavelet  correlation  results  for  template  slides  and  segmentation  results  for  static  and  real-time  FLIR  imagery 
displayed  on  the  LCTV  are  presented.  The  template  slides  of  trucks,  tanks,  and  jeeps  are  essentially  “pre¬ 
segmented”,  since  they  consist  of  constant  intensity  silhouettes  with  no  background  clutter.  However,  tliey  provide 
a  good  transition  to  understanding  the  segmentation  of  the  FLIR  images  by  observing  how  aperture  separations 
and  dilations  control  the  resulting  wavelet  correlation.  Template  slide  correlation  was  accomplished  with  pinhole 
pair  filters  implemented  on  heavy,  black  aluminum  foil  and  detour-phase  computer  generated  holograms. 

Proper  aperture  dilation  which  corresponds  to  wavelet  localization  was  found  to  be  of  utmost  importance  to 
obtain  highly  detailed  edge  enhanced  images.  If  the  aperture  dilation  was  chosen  too  small,  its  corresponding 
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wavelet  overshadowed  any  detail  in  the  input  image.  For  example,  a  first  try  at  correlating  a  “small”  track  shown 
in  Figure  8a  was  to  use  a  pinhole  pair  filter  with  2  mm  separations,  0.5  mm  dilations,  and  different  orientations 
of  0'’,  90°,  and  a  combination  of  both  resulting  in  the  wavelet  projection  shown  in  Figures  8b-d,  respectively. 
Figures  8b  and  c  show  wavelets  correlating  on  edges  in  the  truck  image;  however,  the  wavelets  are  so  large  that 
they  overshadow  any  detail  within  the  correlated  image  and  interfere  with  one  another.  Hence,  the  correlation  that 
resulted  from  the  combined  filter  shown  in  Figure  8d  had  hardly  any  resemblance  to  the  input  image. 


The  best  combination  filter  for  wavelet  decomposition  of  the  small  track  template  was  found  to  be  a  pinhole 
pair  filter  with  6  mm  separations,  3  mm  dilations,  and  orientations  of  30,  90,  and  150°.  The  orientations  were 
chosen  in  order  to  optimize  the  space  available  on  the  filter.  Once  the  optimal  filter  was  determined,  a  permanent 
filter  was  fabricated  by  drilling  the  circular  apertures  into  1/16  inch  aluminum  squares.  A  highly  detailed  edge 
enhancement  of  the  small  uuck  template  slide  was  achieved  using  this  filter.  This  result  is  shown  in  Figure  9f, 
Note  the  fine  detail  along  the  edges  due  to  the  more  localized  wavelet  produced  by  the  filter.  Also  note  that  the 
back  edge  of  tlie  truck  was  not  enhanced.  This  was  due  to  the  filter  not  having  a  0°  orientation  and  illustrates  the 
high  degree  of  sensitivity  the  filter  has  to  orientation. 
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the  small  truck  (Figure  9a)  using  different  filter  configurations  of  aperture  separation  and  dilation.  Figure  9b  is 
the  same  image  as  Figure  8b.  It  came  from  correlating  the  image  with  a  pinhole  pair  having  2  min  separations, 
0.5  mm  dilations,  and  orientations  of  0  and  90°.  Figure  9c  came  from  correlating  the  image  with  a  pinhole  pair 
having  2  mm  separations,  1  mm  dilations,  and  orientations  of  0  and  90°.  Figure  9d  came  from  correlating  the 
image  with  a  pinhole  pair  having  4  mm  separations,  2  mm  dilations,  and  orientations  of  0  and  90°.  Figure  9e 
came  from  correlating  the  image  with  a  pinhole  pair  having  6  mm  separations,  I  mm  dilations,  and  orientations 
of  0,  45,  135,  and  90°.  Note  that  the  detail  in  Figure  9d  is  better  than  that  in  Figure  9e,  Hence,  it  appears  that 
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Figure  7:  Experimental  setup  for  optical  segmentation.  The  inset  is  an  orientation  specific,  bandpass  spatial  filter 
with  circular  apertures. 
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Figure  8:  Example  of  a  template  slide  correlated  with  a  poorly  chosen  wavelet  using  a  pinhole  filter  with  apeitures 
chosen  too  small,  (a)  image  of  template  slide;  (b)  Correlation  result  using  pinhole  filter  at  0°  orientation:  (c) 
Correlation  result  using  pinhole  filter  at  90°  orientation;  (d)  Correlation  result  using  pinhole  filter  at  both  0  and 
90°  orientations 


dilation  is  more  important  than  frequency  for  achieving  highly  detailed  correlations. 


As  a  final  example  of  wavelet  correlation  with  template  slides  using  circular  apertures,  Figure  10  shows  a 
finely  detailed  projection  of  a  multiple  object  template  slide  consisting  of  a  truck,  a  jeep,  and  two  tanks  using  the 
6  mm  separation,  3  mm  dilation,  multiple  orientation  pinhole  pair  filter  described  for  the  coaelation  in  Figure  Of 
above. 

An  example  of  static  FLIR  segmentation  using  a  FLIR  image  displayed  onto  the  LCTV  and  a  permanent  pinhole 
filter  on  an  aluminum  square  with  4  mm  aperture  separations,  2  mm  apermre  dilations,  and  two  orientations  of  0 
and  90°  is  shown  in  Figure  11. 

The  segmented  images  are  not  as  detailed  as  the  ones  obtained  in  che  template  testing  because  pinhole 

separations  were  limited  to  4  mm  and  pinhole  dilations  were  limited  to  2  mm  due  to  the  low  resolution  of  the 

LCTV.  This  is  the  same  filter  that  was  used  for  segmentation  in  Figure  9d.  In  other  words,  the  pinhole  dilations 

could  not  have  been  made  any  wider  without  passing  the  higher  order  periodic  specirums  of  the  LCTV  and  prevent 
28 

thw  segmentation 

The  real-time  FLIR  imagery  was  segmented  using  the  same  permanent  circular  aperture  filter  as  was  used  for 
stat  e  FLIR  segmentation.  A  split-screen  video  tape  was  made  showing  the  unsegmented  FLIR  tape  on  the  upper 
left-hand  comer  of  the  screen  and  the  segmented  image  on  the  upper  right-hand  comer  of  the  screen.  Figure  12 
shows  tire  optical  configuration  used  to  observe  both  the  segmented  and  unsegmented  real  time  FLIR  images 
synchronously,  using  a  beamsplitter  placed  just  before  the  filter,  a  second  lens,  a  second  CCD  camera,  and  a  quad 
input  video  processor.  The  second  lens,  Ls,  had  a  focal  length  of  250  mm,  which  was  smaller  than  the  300  mm 
focal  length  of  L^,  Hence,  the  unsegmented  FLIR  image  scene  is  shown  slightly  smaller  than  the  segmented  FLIR 
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Figure  9:  Wavelet  correlation  of  a  truck  template  slide  using  five  different  pinhole  filters,  (a)  image  of  ternplaie 
slide;  (b)  separations  =  2  miu,  dilations  =  .5  mm,  orientations  =  0  and  90'^;  (c)  s  =  2  mm,  d  =  1  mm,  o  -  0  and 
90“:  (d)  s  =  4  mm,  d  =  2  mm,  o  =  0  and  90°;  (e)  s  =  6  mm,  d  =  1  mm,  o  =  0,  45, 90,  and  135°;  (f)  s  =  6  mm,  d  =  3 
mm,  0  -  30,  90,  and  150° 


Figure  10:  Wavelet  correlation  of  a  multiple  object  template  slide  using  a  multiple,  orientation  pinhole  filter,  (a) 
image  of  template  slide;  (b)  correlation  result 
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Figure  11:  Segmentation  of  static  FUR  image  REFJ16  using  a  pinhole  filter,  (s)  original  FLIR  image;  (b) 
segmentec;  image 
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Figure  12:  Optical  setup  used  for  observing  segmented  and  unsegmented  real  time  FLIR  images  synchronously 
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linage. 


In  this  forum,  the  real  power  of  optical  segmentation  can  be  obser/ed  and  appreciated,  because  of  its  ability 
to  perform  instantaneous  two-dimensional  Fourier  transforms.  A  similar  digital  segmentation  algorithm  would  be 
bogged  down  very  quickly  trying  to  calculate  Fast  Fourier  transforms  (FFT’s)  and  inverse  FFT’s  at  30  framcs.'scc. 
Two  digitized  fiames  of  the  video  (not  consecutive)  are  shown  in  Figure  13.  Noise  around  the  edges  of  the  circular 
window  was  inherent  noise  from  the  lenses  and  the  LCTV  screen.  When  seen  in  real  time,  these  noisy  bright 
spots  are  constant  and  don’t  change  (compare  noise  around  edge  in  segmented  FXIR  image,  frame  1  to  noise 
around  edge  in  segmented  FITR  image,  frame  2).  Further  post-processing  of  the  segmented  FLIR  imagery  could 
be  accomplished  to  remove  this  constant  noise  factor. 


In  this  paper  we  have  presented  an  automatic,  optically  based  image  segmentation  scheme  for  static  and  real¬ 
time  FLIR  imagery  displayed  on  an  LCTV.  The  segmentation  scheme  used  was  based  on  texture  discrimination 
and  employed  neural  based  orientation  specific,  bandpass  spatial  filters  (wavelet  filters)  as  its  main  component.  By 
using  the  proper  choice  of  aperture  pair  separation,  dilation,  and  orientation,  potential  targets  in  FLIR  imagery  were 
optically  segmented  using  spatial  filtering  techniques.  The  output  of  the  system  is  a  correlation  of  the  input  image 
with  the  wavelet  filter.  Neural  network  classifiers  at  AFIT  are  incorporating  the  optical  neural  based  segmentor 
as  a  front  end  processor  which  can  determine  the  locations  of  potential  targets  and  feed  the  classification  neural 
network  witli  the  correlation  peaks  for  their  input  data. 
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Figure  13:  Segmentation  of  two  frames  of  real-time  FLIR  imagery-  using  a  circular  aperture  pair  filter  with  two 
orientations,  0  and  90°.  (a)  original  FLIR  image,  frame  1;  (b)  segmented  FLIR  image,  frame  1;  (c)  original  FLIR 
image,  (d)  bottom  right:  segmented  FLIR  image,  frame  2 
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